Common Metrics for Human-Robot Interaction

This paper describes an effort to identify common metrics for task-oriented human-robot interaction (HRI). We begin by discussing the need for a toolkit of HRI metrics. We then describe the framework of our work and identify important biasing factors that must be taken into consideration. Finally, we present suggested common metrics for standardization and a case study. Preparation of a larger, more detailed toolkit is in progress

The Underpinnings of Workload in Unmanned Vehicle Systems

This paper identifies and characterizes factors that contribute to operator workload in unmanned vehicle systems. Our objective is to provide a basis for developing models of workload for use in design and operation of complex human-machine systems. In 1986, Hart developed a foundational conceptual model of workload, which formed the basis for arguably the most widely used workload measurement techniquethe NASA Task Load Index. Since that time, however, there have been many advances in models and factor identification as well as workload control measures. Additionally, there is a need to further inventory and describe factors that contribute to human workload in light of technological advances, including automation and autonomy. Thus, we propose a conceptual framework for the workload construct and present a taxonomy of factors that can contribute to operator workload. These factors, referred to as workload drivers, are associated with a variety of system elements including the environment, task, equipment and operator. In addition, we discuss how workload moderators, such as automation and interface design, can be manipulated in order to influence operator workload. We contend that workload drivers, workload moderators, and the interactions among drivers and moderators all need to be accounted for when building complex, human-machine systems

Measurement of Situation Awareness Effects of Adaptive Automation of Air Traffic Control Information Processing Functions

The goal of this research was to define a measure of situation awareness (SA) in an air traffic control (ATC) task and to investigate the effect of adaptive automation (AA) of various information processing functions on SA. An ATC simulation was used that was capable of presenting four different modes of control, including information acquisition, information analysis, decision making and action implementation automation, and a manual mode. Eight subjects completed two trials under each mode of control. Operator workload, assessed using a secondary task, was used to trigger automation of the primary ATC task. The SA measure was an adaptation of the Situation Awareness Global Assessment Technique (SAGAT), involving cueing of aircraft positions as well as objective weighting of the relevance of aircraft to controllers for queries. The SA response measure revealed a significant effect of AA on subject perception and overall SA, with superior SA under the information acquisition mode of automation. ATC performance was significantly superior (p\u3c0.05) when automation was applied to lower-order sensory processing functions, including information acquisition and action implementation, as compared to higher-order functions, specifically information analysis. During manual control periods as part of AA trials, ATC performance was significantly superior when following automation of information acquisition and information analysis functions. Secondary task performance was significantly worse under information analysis and decision making automation

Situation Awareness and Levels of Automation

During the first year of this project, a taxonomy of theoretical levels of automation (LOAs) was applied to the advanced commercial aircraft by categorizing actual modes of McDonald Douglas MD-11 autoflight system operation in terms of the taxonomy. As well, high LOAs included in the taxonomy (e.g., supervisory control) were modeled in the context of MD-11 autoflight systems through development of a virtual flight simulator. The flight simulator was an integration of a re-configurable simulator developed by the Georgia Institute Technology and new software prototypes of autoflight system modules found in the MD-11 cockpit. In addition to this work, a version of the Situation Awareness Global Assessment Technique (SAGAT) was developed for application to commercial piloting tasks. A software package was developed to deliver the SAGAT and was integrated with the virtual flight simulator